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directions. Subjects were administered a d ominance _ scale and extreme 
scorers randomly assigned to one of the types of directions, then 
randomly assigned to complete an anxiety scale either before ^or after 
a multiple choice vocabulary test. In the initial study , dominant 
individuals scored significantly higher than submi ssive subjects 
under CT and AEI directions. Low anxious subjects scored 
significantly higher under DHG and AEI directions, while differences 
under CT instructions were nonsignificant. Level of anxiety was 
significantly lower after the vocabulary test under AEI and CT 
directions, but remained the same under DNG directions. The results 
were less clear-cut in the replication, but relationships among 
variables were, for the most part, consistent with the initial study. 
It appears submissive, anxious individuals operate at a disadvantage 
in testing situations which allow some freedom in responding. (Author) 
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TEST DIRECTIONS 



AND STUDENT PERSONALITY 



R.J. Hritz, J, Drugo and S.S. Jacobs 
University of Pittsburgh 



The present study and a replication investigated the effects of 
personality variables on test scores obtained under Answer Every 
Item (AEI), Do Not Guess (DN6) and Coombs' Type (CT) directions* 
Subjects were administered a dominance scale and extreme scorers 
randomly assigned to one of the types of directions, then ran- 
doiTily assigned to complete an anxiety scale either before or af- 
ter a multiple choice vocabulary test. In the Initial study, 
dominant Individuals scored significantly higher than submissive 
sut^jects under CT and AEI directions. Low anxious subjects : 
scored significantly higher under DNG and AEI directions, while 
differences under CT instructions were nonsignificant. Level of 
anxiety was significantly lower after the vocabulary test under 
AEl’and CT directions, but remained the same under DNG direc- 
tions. The results were less clear-cut In the replication, but 
relationships among variables were, for the most part, consis- 
tent with the Initial study. It appears submissive, anxious In- 
dividuals operate at a disadvantage in testing situations which 
allow some freedom In responding. 



A number of studies have concluded that performance In certain 
types of testing situations, e.g. under an announced penalty for guessing, 
may be moderated by personality variables (Swineford, 1933» 19^1; Johnson, 
1941; Hammerton, iSo5; Taylor, 1565; Slakter, 1968). Few studies have ex- 



amined the validity of derived Indices purporting to reflect the operation 
of these variables by examining their relationship with Independent 
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measures of personality. An extensive review of the literature revealed 
only two published studies: Votaw, 1936 and Sherri ffs and Boomer, 195^» 

Votaw found that Ss characterized as submissive and of low 
ability omitted significantly more items under do-nofguess (DMG) direc- 
tions than did ascendant or high ability Ss, but all groups were equally 
capable of answering omitted items when forced to do so. 

Sherri ffs and Boomer found that Ss rated as overly anxious and 
upset tended to omit a significantly greater number of Items than "well 
adjusted" Ss under an announced guessing penalty, and, when required to 
do so, the former group could correctly answer a greater number of omit- 
ted items than could the latter group. 

These studies lend credence to the hypothesis that test perfor- 
mance is moderated by personality factors, and situations In which the 
examinee is given some latitude in responding may be substantially biased 
against certain Ss. 

A test administration and scoring procedure suggested by Coombs 
( 1953 ) appears to have several advantages over DNG and answer-every-l tern 
(AEl) Instructions. Known as Coombs’ type directions (CTD), Ss Identify 
Incorrect rather than correct options. Typically, each correct Identifi- 
cation is worth 1 point. Identification of the correct answer as Incorrect 
results in a penalty of n-1 points, where n is the number of options. Un- 
der CTD, Ss obtain partial credit for partial knowledge, they can be re- 
quired to consider all items and a penalty for guessing is Incorporated. 

However, the possibility exists that the problems noted by 
Votaw, and Sherri ffs and Boomer have merely been shifted from the Intact 
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item to the items' options. 

The present study and a replication investigated the perfor- 
mance of Ss categorized as dominant or submissive and high or low test- 
anxious '.under AEI , DN6, and CTD instructions. Test-taking as an anxiety 
producing experience was also investigated. 

Method 

Ss were 120 graduate students enrolled in an introductory edu- 
cational research course at the University of Pittsburgh. During the 
first weeks of the term, a 26 item true-false dominance scale, based on 
Edwards-type items, (Edwards, 1953) » was administered to all Ss. Ex- 
treme scorers (13 X £9) were then randomly assigned to one of three 
types of test situations; AEI, DNG or CTD. Ss were then randomly assigned 

to complete an 18 Item test anxiety scale, based on Sarason-type i terns, ^ 

2 

either before or after completing a 100 item multiple-choice vocabulary 
test, based on the Quick Word Test (Borgatta and CorsinI, 1951). 

The study was later replicated using under-graduate student 

teachers. 



Results 

The results obtained In the initial study follow. The results 
of the replication are summarized in the attached appendix. 



Personal Communication, Irwin 6. Sarason, February 10, 1968. 
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"Before" Ss were first Informed of the type of directions they 
would be employing, and the scoring procedure. 
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Table 1 summarizes the vocabulary test scores for Ss cate- 
gorized as dominant or submissive, under the three types of Instructions. 



TABLE 1 

Vocabulary Scores of Dominant and Submissive 
Ss, Under Three Types of Instructions 



Personality 




DNG 




AEI 


CTD 


Classification 


n 


X 


s .d. 


n 


X 


s.d. 


n 


X 


S.d. 


DomI nant 


9 


53.0 


4.97 


9 


65.8 


11.02 


9 


157.0 


68.7 


Submissive 


9 


48.0 


10.38 


9 


45.3 


9.05 


10 


90.7 


40.6 



CTD scores represent the summation of Item scores which can 
range from -(n-1) to +(n-l) points. Therefore, a two-way ANOVA was 
employed with the DN6 and AEI data and a t-test was employed with the 
CTD data. 

The two-way ANOVA revealed no significant main effect attri- 
butable to directions (AEI versus DNG), but there were effects attri- 
butable to personality, as well as a significant Interaction. (See 
Table 2) 
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TABLE 2 



Two-way AMOVA Testing Effects of Dominant- Submissive Characteristics 
and AEI and DNG Directions on Vocabulary Test Scores 



Source 


“*KT 1 


MS 


F 


Directions (A) 


1 


196.0 


2.33 


Personality (B) 


1 


1369.0 


16.29* 


A X B 


1 


608,’9 


7.24* 


Within 


32 


84.1 





*P < .05 

The t-test on the CTD data showed dominant Ss performed slgnl 
flcantly better than did submissive Ss. (See Table 3) 

TABLE 3 

t-test on Vocabulary Scores Obtained 
Under CTD for Dominant and Submissive Ss 



Variable 


n 


X 


Std. 


t 


Domi nant 


9 


157.0 


68.7 


2.59* 


Submissive 


10 


90.7 


AO.6 





’''p < .05, one-tailed test 



Table k summarizes the performance of Ss identified as high 
or low test anxious prior to their completing the vocabulary test under 
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the three types of direct tons 



TABLE ^ 

Summary of the Vocabulary Scores of High and 
Low Test“anx!ous Ss under Three Types of Directions 









Test 


DNG 


AEI 


CTD 


Anxiety 


n 


X 


s.d. 


n 


X 


s.d. 


n 


X 


s.d. 


High 


6 


A7.2 


10.05 


6 


53.0 


10.37 


12 


n't. 5 


55.0 


Low 


6 


51.7 


I8.lt 


6 


71.0 


10.9 


10 


121.9 


A3.6 



A two-way ANOVA on the data obtained under DNG and AEI dl 
rections resulted In a significant F for both level of test anxiety 
and type of di recti onSr The interaction was nonsignificant. (See 
Table 5) 



TABLE 5 

Two-way ANOVA Testing Effects of Level of 
Test Anxiety and DNG and AEI Directions 



Source 


"^'df 


MS 


" F 


Test directions (A) 


1 


lOlA.O 


6.11* 


Level of test anxiety (B) 


1 


816.7 


A. 92* 


A X B 


1 


308.2 


1.85 


V/i thin 


20 


. 165.9 





*p < .05 
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A t-test on the differences In performance noted under CTD 
by high and low test-anxious Ss showed the difference to be nonsigni- 
ficant. (See Table 6) 



TABLE 6 

t-test on the Effects of 
Test Anxiety on Performance Under CTD 



Tes t - 




CTD 


Anxiety 


n 


X 


s.d. 


t 


High 


12 


M4.5 


55.0 


-0.3^ 


Low 


10 


121.9 


1*3.6 





To examine the process of test-taking under different direc- 
tions as an anxiety-producing experience, a two-way ANOVA was performed 
on a random sample of Ss who had completed the test anxiety scale either 
before or after completing the vocabulary test. There were significant 
differences attributable to both type of direction and time of measure- 
ment of test anxiety. There was no significant interaction. (See 
Tables 7 and 8) 



TABLE 7 



Anxiety Scores Obtained Under Three Types 
of Directions, Either Before or After Completing the Vocabulary Test 




TABLE 8 

Two-way ANOVA Testing Effects of Time, 
of Measurement of Test Anxiety and Type of Direction 



Source 


df 


MS 


F 


Test directions (A) 


2 


116.3 


8.53* 


Time of Measurement (B) 


1 


7't.Z 


S.'tS* 


A X B 


2 


20. A 


1.50 


Wl thin 


60 


13.6 





*p < .05 



Discussion 

Although the results of the replication are not always In sup 
port of the initial study at conventional levels of significance, the 
lationships among variables are quite consistent. 
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Although the variable was not specifically i nvesti gated , the 
average age of Ss in the two studies differed. This may be partly the 
reason for inconsistencies noted. Also, there were minor differences 
in test administration procedures^ which might have led to "hypothesis- 
testing" behavior on the part of Ss in the replication, (e.g. Ss may 
have expressed "social ly-desi rable" responses to the test anxiety scale 
or dominance scale, rather than made "typical" responses.) 

The di scuss ion wi 1 1 concentrate, therefore, on the consistencies 
and similarities between the two studies. 

Dominant Ss performed better under AEI and DNG directions in 
both studies, which might imply that there is a relationship between 
dominance and ability, I.e. dominant Ss are also the most able. There 
are implications in Kogan and V/allach‘s (19^7) discussion of risk-taking 
correlates that would support this hypothesis. 

Although the difference was significant In only the initial 
study, the relationship between the means of dominant and submissive Ss 
under CTD was maintained in the replication. Dominant Ss are again at 
an advantage over submissive $s« 

Test anxiety appears closely related to test performance under 
AEI and DNG Instructions; low test-anxious Ss tended to outperform high 
test-anxious Ss. This finding was more definitive in the initial study 
but again the relationship among means was consistent in the replication. 
The same phenomenon was observed with reference to type of test direc- 
tion; AEI scores tended to be higher than DNG scores. The CTD data are 
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equivocal. Low test-anxious Ss were at an advantage (although a non- 
significant one) in the initial study, and at a decided disadvantage 
in the replication. This is contrary to expectations based on the im- 
plications of much related research. 

The effects of the test- taking experience on test-anxiety 
seems most consistent for AEI instructions; the initial study revealed 
anxiety diminished under AEI instructions, as did the replication. Ten- 
tatively, it appears that DNG Instructions may Increase them (as seen 
In the replication) and CTP may decrease them. 

One of the principal problems with the present study was the 
small number of subjects available for the various sub-divisions of 
the data. This may have resulted in analyses of low power. The trends 
observed, however, may provide thought for additional research into 
psychological factors effecting test performance. Also the variable of 
age may be relevant to the variables investigated. The possibility of 
"hypothesi s-testi ng" behavior by replication Ss, a possibility minimized 
in the initial study by having different E's administer tests at dif- 
ferent times, may have weakened effects in the replication. 

One may tentatively conclude that AEI directions allow Ss to 
maximize their test performance, when compared to DNG instructions, AEI 
directions also apparently create a less-stressful testing situation. 

The superiority of the AEI format may be due to familiarity; Ss were 
naive with reference to CTD and probably not as familiar with DNG as 




with AEI instructions. 
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APPENDIX 1 

Results of the Replication 

The data in the replication were obtained In essentially the 
same manner as the Initial study. However, the study was done with un- 
dergraduates rather than graduate students. 



TABLE R.1 

Vocabulary Scores of Dominant and Submissive Ss, 
Under Three Types of Instructions 



Personality 




DNG 




AEI 




Cl 


ro 


Class! f 1 cation 


n 


X 


s.d. 


n 


X 


s.d. 


n 


X 


s.d. 


Domi nant 


'3 


59.9 


19.91 


8 


711.8 


10.37 


8 


160.8 


112.68 


Submi ssi ve 


8 


A9.1 


I 1 (. 9 I 


8 


eit.s 


15.59 


8 


139.6 


36.97. 



TABLE R2 

Two-vfay ANOVA Testing Effects of Dominant- Submissive 
Characteristics and AEI and DNG Directions on Vocabulary Test Scores 











Source 


df 


MS 


F 


Directions (A) 


1 


1860.5 


7.67* 


Personality (b) 


1 


861.1 


3.55 


A X B 


1 


1.2 


0.004 


Wi th i n 


28 


2A2.A536 





*p < .05 
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TABLE R3 

t-test on Vocabulary Scores Obtained Under CTD 
for Dominant and Submissive Ss 



Variable 


n 


X 


s • d • 


t 


Dominant 


8 


160.8 


1i2.68 


1.06 


Submissive 


8 


139.6 


36.92 





TABLE R4 

Summary of the Vocabulary Scores of High and Low 
Test-anxious Ss under Three Types of Directions 



Test 


DNG 


AEI 


CTD 




















Anxiety 


n 


X 


s.d. 


n 


X 


S.d. 


n 


7 


S.d. 


High 


6 


55.7 


15.97 


6 


55.7 


12.73 


6 


191.0 


36.77 


Low 


6 


59.3 


20.81 


6 


77.8 


9.62 


6 


140.5 


20.65 



* « »*>»»«« 

TABLE R5 

Two-way ANOVA Testing Effects of Level of Test Anxiety, • ; 

and DNG and AEI Directions 



Source 


df 


MS 


F 


Test directions (A) 


1 


273.37 


1.16 


Level of test anxiety (B) 


1 


651.04 


2.76 


A X B 


1 


273.38 


1.16 


Wi th i n 


20 


235.74 
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Table r6 

t-test on the Effects of Test Anxiety 
on Performance under CTD 









CTD 


Test 

Anxiety 


n 


X 


s. d. 


t 


High 


6 


191.0 


36.77 


2.SU* 


Low 


6 


l^fO .5 


20.65 





«<p < , 05 



TABLE R 7 



Anxiety Scores Obtained Under Three Types of Directions, 
Either Before or After Completing the Vocabulary Test 











A • • - 


DWG 


AEI 


CTD 


Administration 
of Scale 


X 


s. d. 


X 


s.d. 


jT s.d. 


Before (n«ll) 
After (n«ll) 


6.3 

12.5 


5.12 

4.80 


11.8 

9.2 


4.91 
A. 95 


7.8 6 . o'* 

7.8 < 1.53 



TABLE R8 

Two-way ANOVA Testing Effects of Time of Heasu remen t of 
Test Anxiety and Type of Direction 



Source 


df 


MS 


F 


Test directions (A) 


2 


21.58 


0.83 


Time of measurement (B) 


1 


12.25 


0.47 


A X B 


2 


61.58 


2.38 


Wi thin 

— 


30 


25.87 
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